Stein's method for invariant measures of diffusions via Malliavin 

calculus * 



Seiichiro Kusuoka ^ ^ Ciprian A. Tudor ^' ^ 

"^Department of Mathematics, Kyoto University 
Kyoto 606-8502, Japan 
kusuoka@math.kyoto-u.ac.jp 

^ Laboratoire Paul Painleve, Universite de Lille 1 
F-59655 Villeneuve d'Ascq, France. 
tudor@math.univ-lillel .fr 

March 2, 2012 



Abstract 

Given a random variable F regular enough in the sense of the Malliavin calculus, we are 
able to measure the distance between its law and any probability measure with a density 
function which is continuous, bounded, strictly positive on an interval in the real line and 
admits finite variance. The bounds are given in terms of the Malliavin derivative of F. Our 
approach is based on the theory of Ito diffusions and the stochastic calculus of variations. 
Several examples arc considered in order to illustrate our general results. 
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1 Introduction 

Let (O, P) be a probability space and {Wt)t>o ^ Brownian motion on this space. Let F be 
a random variable defined on which is differentiable in the sense of the Malliavin calculus. 
Then using the so-called Stein's method introduced by Nourdin and Peccati in [7] (see also [8] 
and [9]), it is possible to measure the distance between the law of F and the standard normal 
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law A^(0, 1). This distance can be defined in several ways, e.g. the Kolmogorov distance, 
the Wasserstein distance, the total variation distance or the Fortet-Mourier distance. More 
precisely we have, if C{F) denotes the law of F, 

d(/:(F), Ar(0, 1)) < c^E{l - {DF,D{-L)-^F)L2^[o,i])f- (1) 

Here D denotes the Malliavin derivative with respect to W, and L is the generator of the 
Ornstein-Uhlenbeck semigroup. We will explain in the next section how these operators are 
defined. The constant c in ([T]) depends on the distance considered: is equal to 1 in the case of 
the Kolmogorov distance as well as in the case of the Wasserstein distance, c = 2 for the total 
variation distance and c = 4 in the case of the Fortet-Mourier distance. 

The Stein's method related with Malliavin calculus has been generalized to Gamma and 
Pearson distributions (see [TO] and [5]). Our purpose is to extend the above bound to a more 
general class of probability distributions. Actually, given a random variable F regular enough 
in the sense of the Malliavin calculus, we are able to measure the distance between its law and 
any probability measure with a density function which is continuous, bounded, strictly positive 
on an interval in the real line and admits finite variance. Our approach is based on the following 
idea. Consider a given probability density function p which is continuous, bounded, with finite 
variance, it is strictly positive on an interval {l,u) (— oo <l<u< oo) and it vanishes outside 
the interval u). This class includes almost all the commonly used probability densities. Then 
we will construct an ergodic Ito diffusion which admits p as invariant density. The procedure 
to construct such a diffusion is explained in [1] (see also [2] or |13] ) and it will be recalled in 
Section [3] in our paper. The diffusion associated with the density p (by associated with p, we 
mean that it admits p as invariant density) has the form 

dXt = -{Xt- m)dt + ^a{Xt)dWt 

where m is the mean of p, {Wt)t>o is a standard Wiener process and the diffusion coefficient a 
can be written explicitly in terms of the function p and of the constant m (see formula ([S]) in 
Section [3|) . Then we will consider the generator of the diffusion X above and we will use the 
properties of this operator and the integration by parts on Wiener space in the spirit of [7] in 
order to obtain a bound between the law of an arbitrary random variable F and the law with 
density p. This bound, that we will call Stein's bound, will involve the Malliavin derivative of 
F and it reduces to the results contained in [7] and [10] in the particular cases of the Gaussian 
and Gamma laws. 

We mention that there already exists a scientific literature relating Stein's method and 
Berry-Esseen bound to diffusion theory. We refer to the survey |13j and the reference therein 
(see among others [1], [H]) or to the recent reference [5]. The novelty of our approach is 
related to the use of the Malliavin derivatives. This approach has several advantages. Firstly, 
it is unitary, in the sense the Stein's bound we give is available for several metrics between the 
laws of random variables. Secondly, it is rather complete since, as we explain in Section 3, it 
applies to almost every absolutely continuous probability distribution. And thirdly, it allows 
us to characterize the random variables with a given probability distribution in terms of its 
Malliavin derivatives (see Theorem [2]). 
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Our paper is structured in the following way: Section 2 contains the basic notion 
on Malliavin calculus. In Section 3 we construct our general theory to derive the Berry- 
Esseen bound for the distance between an arbitrary random variable and a given probability 
measure. In Sections 4 and we consider several examples (the uniform distribution, the Pareto 
distribution, the Laplace distribution etc) used to illustrate our bound. 

2 Preliminaries 

This paragraph is devoted to introduce the elements from stochastic analysis that will be used 
in the paper. Consider % a real separable Hilbert space and {B{(p),(p € T-L) an isonormal 
Gaussian process on a probability space {Q,A,P), which is a centered Gaussian family of 
random variables such that ^ {B(^p)B{^|J)) = {{p,'tp)-}{. Denote /„ the multiple stochastic inte- 
gral with respect to B (see [12] )■ This In is actually an isometry between the Hilbert space 
?^®" (symmetric tensor product) equipped with the scaled norm -^\\ ■ the Wiener 

chaos of order n which is defined as the closed linear span of the random variables Hn{B{ip)) 
where if S W'-pW'H = 1 and Hn is the Hermite polynomial of degree n > 1 given by 

i^.(x) = ^exp(^-j — (exp(--jj, xeR. 

The isometry of multiple integrals can be written as: for m, n positive integers, 

^ {In{f)Im{g)) = n!(/,5)^®n if m = n, 

^{In{f)Im{9)) = if m/n. (2) 
It also holds that In{f) = In (/) where / denotes the symmetrization of / defined by f{xi , . . . , Xn) = 

;H J2c7eS„ /(^cr(l) 1 • • • ) Xcr{n) ) • 

We recall that any square integrable random variable which is measurable with respect to 
the fj-algebra generated by B can be expanded into an orthogonal sum of multiple stochastic 
integrals 

F = Y,Ufn) (3) 

n>0 

where /„ G 7^®" are (uniquely determined) symmetric functions and /o(/o) = E [F]. 
Let L be the Ornstein-Uhlenbeck operator 

LF = -J2r^In{fn) 

n>0 

if F is given by ([3]) and it is such that J2'^=i "-^'^'ll/n.||^®n < oo. 
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For p > 1 and a G M we introduce the Sobolev-Watanabe space D"'^ as the closure of the 
set of polynomial random variables with respect to the norm 

||F|U,p = ||(/-L)tF||iP(f,) 

where / represents the identity. We denote by D the Malliavin derivative operator that acts on 
smooth functions of the form F = g{B{ipi), . . . , B{ipn)) {g is a smooth function with compact 
support and ipi £ 7i) 

DF = Y,Q^.iB{ipi),...,B{^r.))^,. 

i=l * 

The operator D is continuous from D"'P into B'^"^'^ (T-l) . The adjoint of D is denoted by 6 and 
is called the divergence (or Skorohod) integral. It is a continuous operator from D"~^'P [H) 
into D°'^. The following key relation provides a connection between D,L and 6 and plays an 
important role in the so-called Stein's method: for any centered random variables F G D^'^ it 
holds that F = LL-^F = -6DL-^F 



3 The general theory 

3.1 Ito diffusion with given invariant measure 

In this paragraph we will describe the construction of a diffusion process with given invariant 
measure that admits a density p with respect to the Lebesque measure. We refer to [3] and 
p] for more details and proofs. Assume that the density p satisfies the following conditions: 
it is continuous, bounded, admits finite variance and p is strictly positive on the interval 
(— oo < I < u < oo) and it is zero outside {I, u). Denote by m the expectation of fi and consider 
the stochastic differential equation 



dXt = -{Xt- m)dt + ^a{Xt)dWt, t > (4) 

where {Wt)t>o is a standard Brownian motion and the diffusion coefficient is defined by 

!i - y)p{y)dy 2mF{x) -2 yp{y)dy 

a{x) = ^ = r\ ' x£{l,u) (5) 

p[x) p[x) 

where Fix) = J^^p{y)dy, x G M is the distribution function associated with the density p. 
Then the following holds (see Theorem 2.3 in [3]): 

• The stochastic differential equation (j3D with diffusion coefficient given by (0) has a unique 

Markovian weak solution. 

• The diffusion coefficient a (l5|) is strictly positive for x G {l,u) and satisfies 

a{x)p{x)dx < oo 

where X ^ ^ (this notation means that the random variable X follows the law /x). 
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• The solution X to is ergodic with invariant density p. 



• If — oo < Z or li < oo then Q is the only ergodic diffusion with drift — (x — m) and invariant 
density p. If the state space is the whole real line, then ^ is the only ergodic diffusion 
with drift —{x — m) and invariant density p such that a{x)p{x)dx < oo. 

Table 1 in [3] provided many examples of diffusion associated with a given density p. We will 
use some of them in our paper (the normal distribution, the Gamma distribution, the uniform 
distribution, the Beta distribution, the log-normal distribution, the Laplace distribution, the 
log-normal distribution) and we will recall the diffusion coefficients associated with this law. 
Besides these examples, many others can be found in [3] and the list is not exhaustive. In 
principle for any density that satisfies the rather general assumption described at the beginning 
of this section, one can associate a diffusion process. For some classes of distributions it is not 
possible to determine an explicit expression for the squared diffusion coefficient a similar to 
([5]). In this case, some approximation method can be applied (see Section 3 in [3]). 

Remark 1 The construction of the diffusion process presented above is a particular case of a 
more general result. That is, given a density p as above and given a drift coefficient b such 
that there exists a real number k G {l,u) such that b{x) > for x G {l,k) and b{x) < for 
x £ {k,u), bp is continuous and bounded on {l,u) and 



This way is not the only one to construct a diffusion process with a given invariant density. 
Another method for constructing such a diffusion is given in [3]. 

3.2 Stein's method of invariant measures associated to one-dimensional sec- 
ond order differential operators 

The purpose of this paragraph is to derive the bounds for the distance between the law of an 
arbitrary random variable Y and a given continuous probability distribution. We will situate 
ourselves in the general context described in Remark [H 

Let S be the interval {l,u) (— oo < I < u < oo) and he a probability measure on 
S with a density function p which is continuous, bounded, strictly positive on S, and admits 
finite variance. Consider a continuous function b on S such that there exists k E (/, u) such 
that b{x) > for x € (/, k) and b{x) < for x € (k, u), bp is bounded on S and 




then the stochastic differential equation 



dXt = b{Xt)dt + ^/a{Xt)dWu t > 



with a{x) 
density p. 



2S^h{y)p(y)dy 
p{x) 



has a unique Markovian weak solution which is ergodic with invariant 




(6) 



5 



Define 

p{x) 

Then, the stochastic differential equation: 

dXt = b{Xt)dt + y/a{Xt)dWt, t > 

has a unique Markovian weak solution, ergodic with invariant density p (see Remark [1]). 

In the next result we express the density p in terms of the coefficients a and b. The 
equation in the following proposition is same as the formula (6.22) on page 241 in [6]. 

Proposition 1 Take c ^ S, then 

, , pic)a{c) p ^^dv 
a[x) 

Proof: Relation ([7]) implies that 

Note that the left-hand side of this equality is differentiable, since the right-hand side is dif- 
ferentiable. Differentiating both side, we have 

[a{x)p{x)] = ^^a(x)p(x). 
ax a[xj 

Hence, it holds that 

{loga{x)p{x)y = ^. 

a[x) 

By integrate both sides from c to rr we have the assertion. ■ 

For / G Co (5) (the set of continuous functions on S vanishing at the boundary of 5), 
let mj := f {x)p{x)dx and define gj by, for every x G S", 

2 

9f{x) ■■= . . . s / ifiy) - mf)p{y)dy (8) 



a{x)p{x) 
2 



ifiy) - mf)p{y)dy. (9) 



a{x)p{x) 
Then, by Proposition [1] we have 

gj{x)= — ^exp - / ——dz]dy, x £ S. (10) 

Jl aw V Jy a[z) ) 

Then, gf{x) := Jq gf{y)dy satisfies that / — nif = Agj and by the definition of mj we have 

fix) - E[/(X)] = \a{xrg'f{x) + b{x)~gf{x) (11) 
where X is a random variable with its law ^u. 
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Remark 2 Relation is called Stein's equation and it is a general extension of the Stein's 
equation for normal and Gamma distributions considered in jllOf or 1 13^ . Indeed, when the 
measure jj, is the standard normal distribution A^(0, 1), the state space is S = (—00,00) and 
the coefficients of the associated operator are defined by a{x) = 2 and b{x) = —x. Therefore, 
becomes, for X ~ N{0, 1) 

f{x)-Bf{X) = ~g'f{x)-x~gf{x), x G R. 

When we deal with the Kolmogorov distance and take f{x) = l_(oo,^](2^) then 



9 fix) 



e 2 



[1 



(— oo,z] 



(a) - ^(z)] e 2 da 



which is the solution of the Stein's equation presented in ^ or 113^ for example. 

We also retrieve the results in ^ in the case when ^ is the Gamma distribution. We 
refer to Section 4 for details. 

Now we consider the bounds for the functions gf and g'j-. 

Proposition 2 Assume that there exist l',u' G {l,u) such that b is non-increasing on (1,1') 
and {u',u). Consider / : 5 — )■ M such that gj is well-defined and \\f\\oo ■= sup^^g 1/(^)1 < 00. 
Then we have 



lls/lloo < C'lll/lloo and \\ag'f\ 
where Ci and C2 are strictly positive constants. 



< a 



Proof: Note that the condition imposed on b impHes lini^_^„ b{x) < and hnij,.-;.; b{x) > 0. 
By O, ® and dZD we have 



15/ 1 



X 



I^ifiy) - mf)p{y)dy 



By L'Hopital's rule we have 

hm < lim 



/" Ky)p{y)dy 

f{x) - mj 



b{x) 



where Cf' is a strictly positive constant. Similarly we have 

lim 1 5/ (x) I < Cf 



where is a constant. Hence, the continuity of yields the first assertion. In view of ([TT 
to show the second assertion, it is sufficient to prove 



ll%l|oo<C3 



(12) 
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By ©, (0) and © we get 



\b{x)gf{x)\ < 2 
Since b{x) is non-increasing on [u',u), we have 



/" b{y)p{y)dy 



Kx) I p{y)dy > / b{y)p{y)dy, x£[u',u). 



Hence, since b is positive on {k,u), hmx^u\b{x)gf{x)\ < 2||/||oo- and similarly we have 
linia;-!.; \ b{x)gf{x)\ < 2||/||oo- Therefore, (fT2]l holds from the continuity of bgf. ■ 

Remark 3 The hypotheses assumed on b are satisfied for all the distributions considered 
throughout our paper. This is true because in all the examples the function b is of the form 
b{x) = —(x — m), m being the expectation of the law /i. 

The estimates in Proposition [2] are sufficiently good when a is uniformly bounded and 
strictly positive. But, when a degenerates at the boundary of S, we need another estimate 
instead of the second estimate. 

Proposition 3 Assume that if u < oo, there exists u' G {l,u) such that b is non- decreasing 
and Lipschitz continuous on [u',u) and lim^ _^^, a(x)/(u — x) > 0; if u = oo, there exists 
u' G {Uu) such that b is non- decreasing on [u\u) and lini j.^,,, a(x) > 0. Similarly, assume that 
if I > — oo, there exists I' G u) such that b is non-increasing and Lipschitz continuous on (I, I'] 
and lim.- p^; a{x)/{x — l)> 0; if I = — oo, there exists I' G (/, u) such that b is non- decreasing on 
{1,1'] and lim ^,^^ a(x) > 0. Then we have 



||9/l|oo <C4(||/||oo + ||/'||oo) 

for f G Cq{S) where C4 is a constant. 

Proof: When u = 00, we have lim2,._i.oo 15/(2^)1 ^ ^7211/1100 by a similar argument to that in 
the proof of Proposition [2l Similarly, when / = —00, we have lim2,._i._oo < C2||/||oo- In 

view of continuity of g'j it is sufficient to show that 

]i^\g'f{x)\ < C5(||/||oo + ||/'||oo), when7x<oo, (13) 

x—>-u ■' 

lim|5/(^)l < C'sdI/lloo + ll/'lloo), when /> -00, (14) 

where C5 is a constant. Consider the case that u < 00. Choose e > such that b{x) < —e for 
X G [u',u) and K >0 such that \b{x) - b{y)\ < K\x - y\ for x,y G [u',u). By ([6]), ^ and 
(jlip . we have 

^/^")-a(x)l(^("^ "^^^ !:b{y)p{y)dy 
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Hence, for x G [u' ,u) 



\~g'f{^)\ 



< 



£a{x) f^p{y)dy 
2(u — X 



£a{x) 



[2K 



{f{x) - ruf) / b{y)p{y)dy - {f{x) - mf)b{x) / p{y)dy 

J X J X 

ru ru 

+ {f{x)-mf)b{x) p{y)dy-b{x) {f {y) - m f)p{y)dy 

J X J X 

(/(x) - m/) / [b{y) - b{x)]p{y)dy + b{x) / [f{x) - f{y)]p{y)dy 

J X J X 

2K\\f\\^{u-x)f p{y)dy + b{x)\\f'\\oo{u-x) [ p{y)dy 

J X J X . 

oo oo • 



This estimate and the assumption on a imphes (|13p with a constant C5. When / > —00, we 
can show (jl4p by similar argument. ■ 

There are many examples when our argument applies in Table 1 on Page 8 in [3]. 
Several examples will be discussed in details in the next section. We make below just some 
general comments. 

We are now able to derive the Stein's bound between the probability measure /i and 
the law of an arbitrary random variable Y . The following result extends the findings in [7], 
[lOj in the case where /i is standard normal law and the Gamma law respectively. We mention 
that {•,-)h denotes the scalar product in Ti. 

Theorem 1 Assume X ~ // and let Y he an S-valued random variable in D"*^'^ with b(Y) G 
L?'{Q). Then for every f : S such that gf,g'f are bounded, 



|E[/(y)-/(X)]| < llg^lUE 

+||5/||oo|E[6(y)] 



-a(X) + {D{-Lr' {b{Y) - E[6(y)]} , DY)h 



(15) 



and 



|E[/(y)-/(x)]| < ii^^iUE 



E 



-a{Y) + {D{-Lr' {b{Y) - B[b{Y)]} , DY)h 



Y 



+||5/||oo|E[6(y)] 



Proof: First, by ([U 



E[/(y) - f{X)] = E 



]^a{Yyg'f{Y)+b{Yygf{Y) 



(16) 



(17) 



Recah that LF := -D*DF for F G D^'^ centered. Then, since {-L)-^{b{Y)-^[b{Y)]} G D^'^, 
^1 



E 



iYrg'f{Y) + h{Y)gf{Y) 
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Hence, by (fTTl) 

\E[f{Y)-f{X)]\ 



+ E[b{Y)]E[gf{Y)] 



E 



g'j{Y) Qa(y) + {D{-Lr' {b{Y) - E[b{Y)]} , DY)h^ 



< l|5/|looE 



-a{Y) + {Di-Ly' {b{Y) - B[b{Y)]} , DY)h 



+ B[gyY)]E[b{Y)] 
+ ||5/||oo|E[6(y)]|. 



(18) 



It is possible to give an alternative bound for the distance. Actually, the above calculation can 
be refined as follows. 



= E 
= E 
and thus 



E[/(y) - fix)] 

]-a{Yyg'yY) + {D{-Ly' {b{Y) - E[b{Y)]} yg'yY)DY)H 



+ E[6(y)]E[9^(y)] 



a{Y) + {D{-Ly^ {b{Y) - E[b{Y)]} , DY)h 



Y 



+ E[6(y)]E[^/(y)] 



|E[/(y)-/(x)]| 



< 



15/1 



,E 



E 



\a{Y) + {D{-Ly' {b{Y) - E[b{Y)]] , DY)h 



Y 



+ ||5/||oo|E[6(y)]|. 



Remark 4 a) Theorem{l\ is applicable for functions f G Cq{S). Also the hypothesis b(Y) G 
L^(r2) holds for b{x) = - {x - m) once Y £ D^'^. 

b) In the case fi = N{0, 1) (recall a{x) = 2,b{x) = —x) we obtain from Proposition 2 
that for a centered random variable Y G B^'^ 

sup \E[f(X)- f{X)]\<CE[\l-{D{-Ly^Y,DY)HW 

where C is a constant independent ofY. Notice that in this case we don't need f G Cq{S) due 
to Proposition 2 and Remark 4 since inf^^gR 0(3;) = 2. We mention also that is well known 
from I14f that gf,g'f are bounded under different assumptions on f (see also Lemma 2.1 in 

The Kolmogorov distance dx between the C{F) and C{G) (the laws of the random 
variables F, G) is defined by 

dK{C{F),C{G)) := sup |E[/(F)]-E[/(G)]|. 
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where Fk '■= {l(/,z];-2 £ {l,u)}. For x £ S and f{x) = we can choose /„ S Cq{S) such 

that {fn} is an increasing sequence and fni-c) converges to f{x) for ah x £ S. Hence, by the 
dominated convergence theorem it holds that 

hm |E[/„(F)] - E[/„(G)]| = |E[/(F)] - E[/(G)]|. 

This imphes the fohowing estimate: 

dK{C{F),C{G)) < sup |E[/(F)] -E[/(G)]|. 

/GCo(S); ||/||oo<l 

If mixes cl{x) > 0, then by this estimate, Theorem [H and Proposition [2] we obtain an estimate 
for Kolmogorov distance between X and Y as foUows: 



ia(y) + {D{-L)-' {b{Y) - E[biY)]},DY)H 



+ C\B[b(Y)]\, (19) 



where C is a positive constant. Note that if fi is the normal distribution, we can choose 
a{x) = 2 and b{x) = —x. 

Generally, consider a distance between distributions of random variables F and G on 
S defined by 

dn{C{F),C{G)) :=sup|E[/(F)]-E[/(G)]|, (20) 

fen 

where H is a set of functions on S. If for all f G T-L there exists a sequence fn^F such that 
/„ converges to / in suitable sense, we have 

dn{C{F),C{G)) < sup|E[/(F)] -E[/(G)]|. 

Hence, by this estimate and (llSp we obtain an estimate for the distance between X and Y as 
follows: 



ia(y) + {Di-Lr' {6(y) - E[6(y)]} , DY)h 
+ sup||5/||oo|E[6(y)]|. (21) 



dn{C{Y),fj.) < sup ll^'.llooE 



There are many kind of distance between distributions defined by (|20p . For example, 
by taking Ti = {f : < 1}, where || • ||l denotes the usual Lipschitz seminorm, one obtains 

the Wasserstein (or Kantorovich-Wasserstein) distance; by taking % = {f : < 1}, where 

II"I|bl = ||"||l + ||"||oo; one obtains the Fortet-Mourier (or bounded Wasserstein) distance; 
by taking % equal to the collection of all indicators 1b of Borel sets, one obtains the total 
variation distance. 

In the case of the Wasserstein distance or the Fortet-Mourier distance, for all / G H we 
can choose F := {f £ Cq(S'); ||/'||oo < 1}, because we can choose fn £ {f & Cq; ||/'||oo < 1} 
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such that /„ converges to / uniformly in every compact set. Hence, (j21|) . Theorem [T] and 
Proposition [3] implies that 



dn{C{Y),fi)<CB 



a{Y) + {D{-L)-' {b{Y) - E[b{Y)]} , DY)h 



+ C|E[6(y)]|, 



where C is a positive constant. Note that we do not assume mix^s > in this case. 
This means that, even if jj, has the Gamma distribution, the Wasserstein distance and the 
Fortet-Mourier distance are dominated. 

In the case of the total variation distance, we choose T := Co(5'), because we can choose 
fn S Co{S) uniformly bounded and such that fnix) converges to f{x) for each x £ S. Hence, 
the similar argument to the case of the Kolmogorov distance is available, and if mixes cl{x) > 
we obtain the same estimate ()19p for the total variation distance. 

We will discuss in the next section the significance of the bound given by (jlSp and 
(jl6p . The above computation leads to an interesting characterization of the random variations 
whose distribution is the invariant measure fj, of the semigroup associated with the operator 
A. 

Theorem 2 A random variable Y G B^'^ with its values on S has probability distribution ji 
and satisfies that b{Y) G if and only i/E[6(y)] = and 

1 



E 



-a{Y) + {D{-LrH{Y),DY)H 



Y 



0. 



(22) 



Proof: Suppose that E[6(y)] = and 
the law of Y and /x is zero and then Y 
E[6(y)] = 0. Let h G C^{S). Define 

' 2p(x)dx 



holds. Then, due to p5|) . the distance between 
~ ^. Suppose now that Y ^ j^t. ([6]) implies that 



[a{x)p{x)h{x)] , X £ S. 



Note that ([7]) implies that ap G C^{S). Since h has compact support in S, we have / G Cq{S) 
and '■= Jif{x)p{x)dx = 0. Hence, the definition of / and ([8]) implies that h = g'~ where 

Qj defined by gj with replacing / by /. This argument yields that for h G C^^S) there exists 
/ G Co (5) such that h 

E /i(y)E ^a{Y) + {D{-L)-^b{Y),DY)H Y =0, 



9', 



Thus, ([T8]) imphes 



This finishes the proof, because C^{S) is dense in Cq{S) and the functions in Cq{S) approxi- 
mate the indicator functions. ■ 



Remark 5 a) The same result has been obtained in 111^ or 115^ in the case of the Gaussian 
distribution. 

b) When the random variable {DY, D{—L)^^{b(Y) — E6(y)))// is measurable with re- 
spect to the sigma algebra generated by Y the bound ( fjjj) and U6\) coincide. But, as it can be 
seen in the sequel, this is not always the case. 
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4 Significance of the bound 



The purpose of the section is to check the significance of the bound (]15p . By "significance 
of the bound" we mean the following: given a random variable whose probability law is the 
invariant measure X, then the distance between its law and X is zero. We will prove that 
this is true in the case of several continuous probability distributions: the uniform distribu- 
tion, the log-normal distribution and the Pareto distribution. But it fails in the case of the 
Laplace distribution. That means, for an explicit random variable Y which follows the Laplace 
distribution, we will prove that the right hand side of (jlSh does not vanish almost surely. On 
the other hand, as we have showed in Theorem [21 the right hand side of (jl6p vanishes almost 
surely. This fact can be interpreted as follows: when the random variable {DY, D(—L)~^b{Y)) 
is not measurable with respect to the sigma-algebra generated by Y, the correct Stein's bound 
is the inequality (fT6]) . 

In order to compute the right hand side of (jlSh we need to calculate the random 
variable {DY, D{—L)~^b{Y)) . This random variable (and its conditional expectation given Y) 
appears in several works related to Malliavin calculus and Stein's method (see [^, [E], [IB]). 
In general, it is difficult to find an explicit expression for it Y for general Y. But in the case 
when y is a function of a Gaussian vector we have a very useful formula proved in [11]: if 
Y = h{N) — Eh{N) where h : — )• M is a function of class with bounded derivatives and 
N = {Ni, Nn) is a Gaussian vector with zero mean and covariance matrix K = (-f^j,j)j,j=i,..,n 
then (we will omit in the sequel the index H for the scalar product) 

{D{-Lr\Y - EY), DY) = / e-^duE' Ki~{N) — {e-^N + Vl - e^^^N'). (23) 

Here A^' denotes and independent copy of N and we assume that A^, A^' are defined on a product 
probability space {Q x Q' , J^, P x P') and E' denotes the expectation with respect to the 
probability measure P' . Formula ()23p is a consequence of the Mehler formula (see e.g. |12j ) 
and it has been proved in [11], subsection 3.2.1. In the rest of this section the following context 
will prevail: {Wt)t^[Q^T] '^iH denotes a standard Wiener process on (fi, J^, P), by W{h) we will 
denote the Wiener integral of /i G -^^^([0, T]) with respect to W and W' will be an independent 
Wiener process on a probability space {Vt\J-\P'). 

4.1 The Gamma distribution 

The case of the Gamma distribution is already known. The Stein's bound (llSh has been 
obtained in [7] , [lOj and already discussed in Section [3l We prefer to discuss it further in order 
to compare the bounds ([15]) and ([THl) . We will consider the random variable 

Y = W{hf 

which has Gamma distribution with parameters o = ^ and A = ^. This is actually the 
chi-square distribution and its associated coefficient are 

a{x) = Ax and b{x) = — (x — 1). 
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Proposition [3] implies that (note the assumptions are satisfied by the functions a, b above 
defined on the state space (0, oo) 

\BfiX) - E/(y)| < C(||/||oo + ||/'||oo)E \2Y - {DY,D{-L)-\Y - 1))| + |Ey - 1| (24) 

for any / G Cq(0, oo). Note that BY = 1 for our choice of Y. 



Remark 6 The bound (24) is a variant of inequalities (3.48), (3.49) in ^ which are stated 
for the centered Gamma law and different classes of functions instead o/Cq(0, oo). 



X 



2 



We can easily compute the scalar product {DY, D{—L) ^{Y — 1)) using ()23p with /i(x) 

{DY,D{-Ly\Y - 1)) = 2W{x) [ da2E' \aW{h) + ^/l - a'^W\h) 

Jo L 

= 4W^(/i)2 / ada = 2W{hf = 2Y. 
Jo 

We can notice that the random variable {DY, D{—L)~^(Y — 1)) is measurable with respect to 
the sigma algebra generated by Y. Therefore the bound (jlSp and (116p coincide and Theorem [2] 
provide an interesting characterization of the chi-square distribution random variables in terms 
of the Malliavin derivatives: that is, a random variable Y has chi-square distribution (with one 
degree of freedom) if and only if {DY, D{—L)~^(Y — 1)) = 2Y almost surely. 

4.2 The Uniform distribution 

We will discuss the case of the uniform distribution U{[a,b]) with oo < a < 6 < oo. The density 
of this law is Pa,bix) = j;^^[a,b]{^) and the mean of Pa,b is ^y^. We will actually restrict to the 
particular case a = 0,6 = 1 and let p{x) := Po^i{x) = l[o;^](x). This density is associated with 
the stochastic differential equation 

dXt = -{Xt - ^)dt + ^/Xt{l-Xt)dWt 

in the sense that the solution X to the above equation is ergodic with invariant measure 
^ ~ C/([0, 1]). The diffusion coefficients a and b are in this case defined on (0, 1) and given by 
(see Table 1 in [1]) 

a{x) = x(l — x) and b{x) = —{x — -). (25) 
Let y be a random variable in the space D^'^ such that 

Ey = EC/[0, 1] = ^. 

In this case the Stein's bound (|15p becomes, for any function / G Cg([0, 1]) (we mention that 
a satisfies the assumptions in Proposition [3] since lim^,.-!.! = lim^_5.o = 1) 



|E/(y)-E/(C/[0,l])| < c 



E^a{Y)-{Di-Lr\Y-^),DY) 
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c 



E^y(i - y) - E(i)(-L)-i(y - dy) 



Let us check "how good" is this bound on an example. Let f,g € L^([0,r]) such that 

lL2([o,r]) = II9||l2([o^t]) = 1 and (/, 5)l2([o,t]) = 0- 



Then W{f) and W{g) are independent standard normal random variables. Define the random 
variable Y by 

y = e-H^(/)'+^(9)'). (26) 

Then it is well-known that Y has uniform distribution f7([0, 1]) since the random variable 
— ^(W{f)'^ + W{g)'^^ has exponential distribution with parameter 1. It is also clear that 
y e Note also that Y can be expressed as a function of the Gaussian vector {W{f), W{g)) 
whose covariance matrix is the identity matrix I2. Indeed, Y = h{W{f),W{g)) with 

h-.M.'^^R, h{x,y) = e-^^'^'+y^l 



The function h satisfies the assumption in order to apply ()23p . Applying this formula to the 
random variable ([26]) we get 

{D{-Lr\Y-^),DY) 

/•oo 

= W^(/)e-2(^(/)'+^{f)')E' / e-"(in(e-"W^(/) + VT^e^W\f)) 

Jo 

^g-|[(e-"Vy(/)+Vl-e-2"H/'(/))2+(e-"ty{3)+Vl-e-2"iy'(g))2] 

POO 

+t^(5)e-2(^(/)'+^(9)')E' / e-"dn(e-"VF((7) + \/l - e"2«VF'(g)) 

Jo 

^g-i[(e-"W(/)+Vl-e-2"H/'(/))2+(e-"Vl/(g)+Vl-e-2"iy'(g))2]^ 

We made the change of variable e~" = a and then 

{D{-Ly\Y-^),DY) = VF(/)e-3('^(/)'+^(^')')E' / da{aW{f) + Vl- a^W'{f)) 

y-^-^[{aW(f)+VT^W'{f))'' + (aW{g)+Vl^W'{g))^] 

Jo 

X g-M{aiy(/)+v^T^iy' {/))2 + (aM/(3)+v^T3^iy' {g))2] _ ^27) 

At this point we need the following lemma. It will be widely used throughout the paper. 
Lemma 1 Let K > -1, C eR and a G (0, 1). Suppose Z ~ N{0, 1). Then 

^l + 2K{l-a?) 
15 



and 

^ ^ (l + 2K(l-a2))2 

Proof: The proofs for the two equations are almost same. We only show the second one. 



= ^ [ (C + \/r^x)e-^(^+^"")'e-4(ix 



27r 

^^^=^^^= C — e l + 2A'(l-a^ 

Vl + 2K(l-a2) V 1 + 2ii:(l - a2) 

C -C'^K 1 ^ 

_g l + 2X{l-(i^) 



(1 + 2i^(l - a2)) 



Now, using Lemma [H we have 

^,^-l{aW{g)+VT^W'{g)f ^ ^"2 (a-a^) (2 - a2)-5 

E'(aW^(/) + 7r^VF'(/))e-2("^{/)+v'i^w/'(/))' = W{f)e ^^^^{2 - a'^yia. 
By inserting the above two identities in ()27p we obtain 

- \l DY) = iW{ff + Wiaf) f e'^(^(^)'+^(^)')^(2 - a^Y^ada. 
^ Jo 

Since for any constant c 



d c—^ c—^ 2ac 
-e = e 



da^ ^ (2 - a2)2 

we get (with c = -{W{ff + W{gf)) 



On the other hand, using (j25]) . 

a(y) = Y{1 - Y) (29) 
and by ()28p and ()29p we concluded that the right hand side of (jl5p is zero. 

Remark 7 /i is interesting to note that ^a{Y) — {D{—L)~^(Y— ^),DY) is zero and not only 
the expectation of its absolute value. That is, this quantity is zero for every w € $7. We will 
also mention that in this case the random variable {D{—L)~^{Y — ^),Dy) is measurable with 
respect to the sigma-algebra generated by Y . Therefore the bounds il5\) and l[16\) coincide. 
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4.3 The Beta distribution 



Using the computations in the previous paragraph, it is immediate to treat the case of the 
beta distribution with a particular choice of its parameters. Recah that the density of the 
beta distribution with parameters a,/3 > is Pa^pix) = Y(a)r{l) ^"""^(l ~ ^)'^~^l(o,i)(^)- The 
mean of this law is while the coefficient of the diffusion associated with the beta law are 

O'i'^) = ^^^^(1 ~ ^iid b{x) = —{x — -^^rp)- Similarly to the case of the unform distribution 
we can check that a and b satisfies the hypothesis of Proposition ([3|). We will restrict here 
to the special case a = |,/3 = 1. The distribution is a power-function distribution. 

It is well-known that if X ~ C/[0, 1] then X'^ ~ /3(i, 1). Consider the random variable Y = 
e-iWU?+W{gf)_ Tj^gj^ obviously Y ~ Using formula ^ with h{x,y) = e-^'+2'', 

Lemma [U we get 

^DY,D{-L)-\Y - \)) = \a{Y). 
Again the random variable {DY,D{—L)^^{Y — ■^)) is measurable with respect to Y. 

4.4 The log-normal distribution 

We analyze here the case of the lognormal distribution. Let us first review some basic prop- 
erties of this probability distribution. A random variable Y has lognormal distribution with 
parameters 5 and o"^ if log Y has normal distribution with mean 5 and variance . The density 
of the log-normal distribution with parameters 5 and o"^ > is 

^=V^"^^'°'''"'^'l(0'-)(") (30) 
and the coefficients of the associated diffusion are defined on (0, oo) and given by 

h{x) = -(x-e^+^"') 

and 

(see [3], page 8)), where ^ denotes the cumulative distribution function of the standard normal 
law, p is given by (|3U|) . We check the significance of the bound in the case of the lognormal 
distribution with parameters 5 = and a = 1. The function a satisfies lim3;^oo a{x) = oo and 

X Jlogx—l — 

Let us consider the random variable 

Y = e^^'^) 

where h G L^{[0,T]) has norm equal to 1. Then obviously Y follows a lognormal law with 
mean 6 = and variance a = 1. Let us first compute the scalar product 

{DY, D{-Lr\b{Y) - Eb{Y))) = -{DY, D{-Lr\Y - e^)). 
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Using formula ([25]) we get 

{DY,D{-L)'\Y -e-^)) 



-"Vl/(/i)+\/l-e-2"M/'(/i)' 



^('^) / daB' 



,aW{h)+VT^W'(h) 



where W'{h) denotes an independent copy of W{h). Since 



E' 



,aWih)+VT^W'(h) 



gaty{h)gi(l-a2) 



we obtain 



{DY,D{-L)-\Y - e'^)) = e^^''') / dae^^^'^h'^^^-'"'') 

Jo 



W(h) i 



2 /-i 



1 M^W^ f^W _^ 
e 2 



where we used the change of variables W{h) — a = x. Let us now compute 



la(y) = e^p(Y)-^ ($(log(y)) - $(log(y) - 1)) 



1 log(y)^ 
e 2 2 / 

yiog(Y)-i 



e "2 = e2e^*-'^^e 2 ' 



.7„.2 /-M/Ch) _^ 

e 2 dx 

W(h)-1 



where we use the formula (j30p for the density of the lognormal distribution and the expression 
of the operator a. We can see that 



1 



a{Y) - {DY,D{-Ly\Y - 62)) = 0. 



Remark 8 Again the quantity ^a{Y) — {DY, D{—L) ^(Y — e^)) vanishes and not only its 

expectation. Also {DY, D{—L)~^{Y — e^)) is measurable with respect to the sigma algebra 
generated by Y. 

4.5 The Pareto distribution 

Let us recall some basic properties of the Pareto distribution with parameter a > 1 (denoted 
in the following by Pareto{a)). The probability density function of this law is 

p{x) = a(l + 

and its expectation is m = The functions a and h associated to the diffusion equation 

whose invariant measure is Pareto{a) are given by 

2 1 

a{x) = x(l + x) and b{x) = —{x ), x G (0, 00). 

a — 1 a — 1 
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It is standard to see that a, b verifies the statement of Proposition [3j 

We recall a well-known fact: if the random variable X follows a Pareto distribution 
with parameter a > 1 then 

log(y + 1) ~ Exp{a). 

Let us consider the same context as in the previous examples. That is, we are on a probability 
space {VL, F, P) and let (VFt)tG[o,T] be a Wiener process on this space. Consider two orthonormal 
elements /ii,/i2 £ -^^([0;^])- Then W{hi),W{h2) are independent standard normal random 
variables and 

w{hif + w{h2f ~ Exp{^) = r(i, 

Consider the random variable 

Then, since liW{hif + W{h2f) ~ r(l,2) = Exp{2), we can see that Y follows a Pareto 
distribution with parameter a = 2. Clearly, we have 

-a{Y) = ¥{1 + Y) = el(^('^i)'+^(^2)') - e3(^(^i)'+^(^2)2)_ 

Using (I23D with h{x,y) = e4(^'+2^') - 1 we will get (we recall that W' is an independent copy 
of W, see the beginning of this section) 



{DY,D{-LrHY-l)) 



-W{hi)e^4(^^'''>^'^^^^> > / da- 

2 In 2 



E' 



2 . n 2 



E' 



and by Lemma[T]with K = ^ and C = aW {hi) , aW {h2) respectively, we can write 
{DY, D{-L)-\Y - 1)) = y(l + Y) = ^a(y). 

4.6 The Laplace distribution: Failure of the bound (1151) 

The Laplace distribution with parameter a > (denoted by Laplace{a)) is a continuous 
probability distribution with density Pq{x) = ^e""'^', for every x e M. The mean of the law 
is m = and the diffusion coefficients ([5]) are 

2 

a(x) = —^{1 + a\x\), b(x) = —X. (32) 
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Is is known that if Xi,X2 are two independent random variables such that Xi ~ Exp{a), X2 ~ 
Exp{a) then Xi — X2 ~ Laplace{a). 

Let us analyze the case of the Laplace distribution with parameter a = 1. In this case, 
(j32|) reduces to 

b{x) = —X and a(x) = 2(1 + |x|). 

Here the state space is whole real line (—00,00) and we can apply Proposition [2] in order to 
obtain the Stein's bound. Consider the random variable 

Y = l {W{hif + W{h2f - W{h^f - W{h^f) 

where as above hi (z = 1, ..,4) are orthonormal functions in L^([0, T]). Since 

^ {W{hif + W{h2f) ~ Exp{l) and ^ {Wih^f + Wih^f) ~ Exp{l) 

it can be easily seen that Y ~ Laplace{l). It is easy to compute the quantity {DY, D{—L)~^b{Y)) 
using formula ([25]) . We obtain, 

{DY,Di-L)-^b{Y)) = -{DY,D{-L)~^Y) 

= -l{W{hi)^ + W{h2)^ + W{h3f + W{h4f). (33) 

It is obvious that is this case the difference ^a{Y) + {DY, D{—L)^^b{Y)) does not vanish almost 
surely. This signifies that the bound given by inequality (jl5|) is not good in this case and it 
has to replaced by (jl6p . Theorem [2] ensures that the right hand side of (jl6p vanishes almost 
surely. The reason why the bound (|15p fails is given by the fact that the random variable 
{DY, D{—L)^^b{Y)) is not measurable with respect to the sigma-algebra generated by Y. 

The case of the Laplace distribution can be discussed on an other examples. Consider 
four independent standard normal random variables W{hi), W{h2), W^h^), W{h/^) and define 

Yi = W{hi)W{h2) + W{h3)Wihi). 

Then again Yi follows a Laplace distribution with mean zero and variance 1. And we can see 
that again the expression (j33p holds for the random variable Yi. Then 



^aiY,) + {DYi,Di-Lr'biYi)) 

= 1 + \W{hi)W{h2) + W{h3)W{hi)\ - ^ {W{hif + W{h2f + Wihsf + Wih^f) 
and this does not vanish. On the other hand, we know from Theorem [2] that 

E (\a{Yi) + {DY,D{-Lr'b{Yi)) Yi ) = 0. 
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in this way we will obtain some interesting (and somehow unexpected) identities for functions 
of the Brownian motion, which are difficult to be proven directly. That is 



E 



^ {W{hi)^ + W{h2f + W{h^f + W{h^f) 
1 + \W{hi)W{h2) + W{h^)W{hi)\ 



W{hi)W{h2) + W{h^)W{hi^ 



and 



E ( \ {W{hif + W{h2f + W{h:,f + W{h^f) \ [W{h^f + W{h2f - Wih^f - W{Uf] 



1 + 



1 



5 Example 

We will illustrate the bound obtained via Stein's method through an example. Consider (/ii)i>o 
a sequence of orthonormal elements of L^([0,T]) and define for every i > 1 



X, = e 



(the minus sign is added in order to have finite expectation) and 

Yat = (Xi....XAr)^ = e 



(34) 



(35) 



Then, applying the central limit theorem to Sj=i(W^(^t)^ ~ 1)) have that converges 
in distribution, as — )■ oo, to the log- normal distribution with mean zero and variance equal 
to 1. Let us compute the bound given by the right hand side of (jlSp and (jl6p . Define a, h and 
p same as in Section [4.41 In this case we have 



|E/(y;v)-E/(X)| <CE 
Since, with Z ~ iV(0, 1) 



\{Yn) - {DYN,D{-Ly^ (Yn - 



+ C' 



^{YN-e-2) 



-N 



WYi 



N 



— ( 1 y2 

eV 2 ( Ee 



I N_ 

ev 2 



'1 + 



we can see, by studying the asymptotic behavior as — )• oo of the above sequence, that 
— )-Ar_!.oo C with C a strictly negative constant. We compute now a{Yp^) where a 
is the function given by ([3T|) with n = ,6 = and a = 1. Denote by 

N I ^ 

^Tv = ^ l^(/i.)' and Z;v = -^ J](W^(M'-1)- 

i=l 1=1 
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We will have 

1 . . U Z"'"*^^^ I , 1-7 /""^^ 

Now, using (j23p with ...,xn) = e V2iv ^^=1^ * we can write 

{DYn, D{-Lr^ {b{YN) - Bb{YN))) = {DYn, D{-Lr^ (Yn - 
N ry 

i=l 



X J da^B' (aW{hi) + ^/l - a^W'{hi)^ e ^ 

N 

N 



1=1 



X 



By applying Lemma [U with K = and C = aW{hi) we obtain 



2N 

aW{hi) -a2V^(fe,)^^ 2i(,_„2) 



1 + 73^(1 



Using the above two identities and ((3 
{DYn,D{-L)-^ [YM-e^ 



iV+2 



22 



[ ^ -^jv + 2) /" daae 
WN Jo 



l + ^=(l-a2)) l+^al(l~a"2y) 



iV+2 
2 



Since 



log(l + \/^(l-a^) 



|(l-a^)-^|(l-aY + o(iV-^) 



where o{N ^) is of Landau notation, and hence 



N+2 



l + t/-(l-a^) 



we win have 



{DYn,D{-L)-^ (Yn -e^)) = + 2) I daae 

^ ^ yN Jo 



1 -^iv(l+a \^ .J 



+ -Bat, 



where 
-Bat : = 



iV Jo 



e V2JV 

„2 



^77— 2t)v 2 _iV+2/ / 2 /I 2 n- rt2^2 



(J^(l-a2)-l 2(i_„2)2+„(^-l)) 



2 / daae e V2n^ ' - 2 iv 





e 

^^^JV - _A[+2( A(l-a2)2+o(7V-i)) 



We will first show that 



E 



NAn 



where Co is a strictly positive constant. We can write, using the change of variables a^ = h 
with 2ada = db 



E 



NA 



N 



V2E\Zn\ / dbe 



1 -ZN{l+b- — ^f;^) Vf 



1-6- 



-(1-6) 



a9N{b) 



where 5Ar(6) = el(i"^)'+<'(i). Therefore 



E 



NA 



N 



Jo 



+y/2 



\ 



1 -Zjv(l+6 ^ 

E|Z;v| / c^fee 




1-6- 
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-EIZtvI dfte-^'^^^+^^e^^^-^^e^^^^^) 
Jo J 

Since Zjv converges in law to A^(0, 1), the first summand above converges as — )• oo to 

while the second summand converges to zero as — ?• oo by the dominated convergence theo- 
rem. Let us handle the summand denoted by Bjq. Actually, we will prove that 



A^E 



>N^oo Dq 



(38) 



with Dq a strictly positive constant. First, we write 



B 



N 



1 -Zjv(l+f>- 

dbe 



e 



1-6- 



-(l-b) 



o9N{b) 



^^^^ZM(l+b)^b(l-b)^\{l-bf 



+ C dh 
Jo 



( 



-Zjv(l+6- 



1-6- 



-(1-6) 



e^ivW _ e-2iv(i+b)g6(i-b)e|(i-b)' 



^(1) , ^(2) 



and the limit ([38|) follows since (see ([36|) ) i?^^ = ^a(YAr) and for A^ large. 



1 - h- 



1 + Jf(l-6) 



(l-6) = 5(l-6)y| + o(-^) 



and 



-Zjv(l-h6 



< c 



l^ivl 



A^ 



As a conclusion of the computations contained in this section, the distance between the law 

of Yat given (|35p by and the log-normal distribution with mean and variance 1 is of order of 
1 
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